# BERT Distillation

This model is a fine-tuned version of bert-base-uncased on an unknown dataset, primarily used for text classification tasks.

This is a pruned and optimized BERT Q&A model, retaining 38.1% of the original model's weights, fine-tuned on the SQuAD1.1 dataset, supporting English Q&A tasks.

This model is a fine-tuned version of distilbert-base-uncased on the SQuAD question answering dataset, suitable for question answering tasks.

Dynamic-TinyBERT is an efficient question answering model that improves inference efficiency through dynamic sequence length reduction, achieving up to 3.3x speedup while maintaining high accuracy.